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@ Digital video signal converting apparatus. 

(57) A digital video signal converting apparatus 
for converting a first digital video signal having 
a first resolution to a second digital video signal 
having a second resolution higher than the first 
resolution, comprises; block segmentation cir- 
cuit for converting the first digital video signal 
into a block fonnat, memory having a mapping 
table stored therein and having address tenmi- 
nals to which the first digital video signal in a 
block fomiat is supplied and output terminals 
from which the second digital video signal in 
block fonmat is output, and block separation 
circuit for converting the second digital video 
signal in a block format into a digital vkieo 
signal in a raster scan order, wherein the map- 
ping table in the memory is generated by train- 
ing utilizing a plurality of images the training 
step being perfonmed by generating first and 
second digital video signal corresponding to 
each of the plurality of images, converting each 
of the first and second digital video signals into 
a block fonnat, and selecting the first digital 
video signal in a block fonnat is an address 
signal for the mapping table and inputting the 
second digital video signal in a block fonmat to 
a memory area con'esponding to the address, 
and generating data of the mapping table from 
the signal stored in the memory area. 
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The present invention relates to digital video sig- 
nal converting apparatus which can compensate a re- 
solution and which can be applied to. for example, an 
up conversion for converting a television signal of a 
standard resolution into a television signal of a high 
resolution. 

According to previous proposals, data of pixels 
which lack is compensated by an interpolation filter in 
an up conversion for converting an image of a stan- 
dard resolution or a low resolution (they are abbrevi- 
ated to SD) into an image of a high resolution (abbre- 
viated to HD), an electronic zoom, or an enlargement 
of an image. 

However, there is a problem such that a resolu- 
tion of the output image obtained by the interpolation 
by the filter deteriorates. For example, a hatched por- 
tion shown in Fig. 1 is a region of a video signal of SD. 
Even when a television signal of HO is formed by in- 
terpolating the video signal by the filter, an HD conrv 
ponent (high frequency component) which doesn't ex- 
ist in the input SD signal is not reconstructed. Conse- 
quently, the resolution of the output image deterior- 
ates. 

According to an aspect of the present invention, 
there is provided a digital video signal converting ap- 
paratus for converting a first digital video signal hav- 
ing a first resolution to a second digital video signal 
having a second resolution higher than the first reso- 
lution, comprising: 

block segmentation means for converting the 
first digital video signal Into a block format, 

memory means having a mapping table stored 
therein and having address terminals to which the 
first digital video signal In a block format Is supplied 
and output terminals from which the second digital 
video signal in block format Is output, and 

block separation means for converting the 
second digital video signal in a block format into a dig- 
ital video signal In a raster scan order, 

wherein the mapping table in the memory 
means Is generated by training utilizing a plurality of 
pictures the training step being performed by gener- 
ating first and second digital video signal correspond- 
ing to each of the plurality of pictures, converting each 
of the first and second digital video signals into a 
block format, and selecting the first digital video sig- 
nal in a block format is an address signal for the map- 
ping table and inputting the second digital video sig- 
nal in a block format to a memory area corresponding 
to the address, and generating data of the mapping 
table from the signal stored In the memory area. 

Embodiments of the Invention provide image 
converting apparatus which can reconstruct a high 
resolution component and can compensate a resolu- 
tion. 

The mapping table can be formed so as to indi- 
cate the correlation between two image signals by us- 
ing original images of various picture patterns for 



training. Therefore, a high resolution component 
which is not included in the input image signal can be 
reconstructed by the mapping table. 

Embodiments of the invention will now be descrl- 
5 bed, by way of example, with reference to the accom- 
panying drawings in which: 

Fig. 1 is a schematic diagram to explain a previ- 
ous proposal; 

Fig. 2 is a block diagram showing a construction 
10 of an embodiment of the invention; 

Fig. 3 Is a schematic diagram to explain a block 
construction; 

Fig. 4 is a block diagram of an example of a con- 
struption to form a mapping table; 
15 Fig. 5 is a schematic diagram to explain a block 
construction of another embodiment of the inven- 
tion; 

Fig. 6 Is a block diagram of an example of a con- 
struction to form a mapping table of another env 

20 bodiment of the inventton; 

Fig. 7 is a block diagram showing a construction 
of still another embodiment of the Invention; 
Fig. 8 Is a block diagram of an example of a con- 
struction to form a mapping table of the embodi- 

25 ment in Fig. 7; and 

Fig. 9 is a block diagram of an example of a con- 
struction to interpolate data when a mapping ta- 
ble Is formed. 

An embodiment of the Invention will be explained 

30 herelnbelow. The embodiment relates to an example 
In which an SD video signal is up converted into an 
HD video signal. In Fig. 2, a digital SD video signal Is 
supplied to an input terminal shown by reference nu- 
meral 1. As an example of the SD video signal, there 

35 Is a reproduction signal of SDVTR, a broadcasting 
signal, or the like. The SD video signal Is converted 
from an order of an ordinary raster scan to an order 
of blocks by a block segmentation circuit 2. 

As shown in Fig. 3, a video signal converted into 

40 a block 5s of (2 x 2 x 8 bits = 32 bits) Is generated as 
an output of the block segmentation circuit 2. The sig- 
nal of 32 bits is supplied to a memory 3 as addresses. 
A mapping table based on the correlation between 
the SD Image and the HD image has been stored into 

45 the memory 3 as will be explained hereinlater. The 
memory 3 Is constructed by, for example, a non-vot- 
atile RAM. 

A video signal of a block 5h of (4 x 4 x 8 bits) is 
read out from the memory 3 as shown in Fig. 3. The 

50 position of the block 5h which occupies in one picture 
plane (one field or one frame) is equal to that of the 
block 5s of the input image. More practically speak- 
ing, since an aspect ratio of a monitor for HD to which 
an output image is supplied Is set to (16 : 9), the out- 

55 put block 5h corresponding to, for example, the block 
5s at the left upper corner of the input Image is used 
as an upper image block on the inner side than the 
left upper corner. Even when the output image ob- 
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tained from the SD image of an aspect ratio of (4 : 3) 
is supplied to the monitor for HD, therefore, informa- 
tion on both sides of the picture plane of the monitor 
lacks. The lack information on both of the right and 
left sides can be set to blanking portions or can be 5 
also interpolated. Since the embodinents to be descri- 
bed are not directly concerned with the above proc- 
essing, its detailed description is omitted. 

Output image data read out from the memory 3 
is supplied to a block separating circuit 4 and the or- io 
der of the data is converted into the order of the raster 
scan. Output image data from the block separating 
circuit 4 Is taken out to an output terminal 5. The mon- 
itor for HD is connected to the output terminal 5 
through a D/A converter (not shown). The number of is 
pixels of the output image is 4 times as large as the 
number of pixels of the input SD video signal and the 
HD image can be reproduced by the monitor for HD. 

An example of a construction to make the map- 
ping table which is stored in the memory 3 is shown 20 
in Fig. 4. In Fig. 4. a digital HD video signal is supplied 
to an input terminal shown by reference numeral 11. 
It is desirable that the HD video signal Is a standard 
signal in consideration of the formation of the map- 
ping table. For example, a signal comprising still inr>- 25 
ages of various pteture patterns can be used. The HD 
video signal can be actually obtained by photograph- 
ing a standard image by an HD video camera or by re- 
cording an image pickup signal into an HDVTR. Fur-, 
ther, when the HD video signal to be derived as a con- 30 
version output has previously been known, generality 
is not requested. Therefore, the mapping table is 
formed by using an original HD video signal. 

The HD video signal is supplied to a block seg- 
mentation circuit 12. The block segmentation circuit 35 
12 converts the video signal of the order of the raster 
scan into the structure of the blocks of (4 x 4 x 8 bits). 
Two signals having different resolution are formed 
from an output signal of the block segmentation circuit 
12. One ofthe two signals is a signal having the same 40 
resolution as that of the original HD video signal and 
is obtained as an output of a delay circuit 1 3. Another 
signal is an SD video signal and is formed by a low 
pass filter 14 and a sub-sampling circuit 15. The low 
pass filter 14 is a two-dimensional digital filter and 45 
executes a band limit in the horizontal and vertical di- 
rections in order to prevent an aliasing distortion. The 
sub-sampling circuit 15 performs the sampling such 
that the numbers of pixels in the horizontal and vert- 
ical directions are reduced into 1/2, respectively. so 
Therefore, one block of the SD video signal from the 
sub-sampling circuit 15 corresponds to the data of (2 
X 2 X 8 bits ^ 32 bits). 

The SD video signal from the sub-sampling cir- 
cuit 15 is supplied to a memory 20 and a frequency 55 
memory 21 as their addresses. The memory 20 has 
address spaces of 2^ and data of (4 x 4 x 8 bits = 1 28 
bits) is written into those addresses. Although the fre- 
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quency memory 21 also has the same address space 
as that of the memory 20. a frequency is written as 
data into the respective address. That is. read-out 
output of the memory 21 is supplied to an adder 22 
and is increased by -i-l and an output of the adder 22 
is written to the same address in the memory 21 . The 
contents of the addresses in the memories 20 and 21 
are cleared to zero as initial states. 

The data of 128 bits read out from the memory 20 
is supplied to a multiplier 23 and is multiplied to a fre- 
quency read out from the frequency memory 21. An 
output of the multiplier 23 is supplied to an adder 24 
and is added to Input data from the delay circuit 13 by 
the adder 24. An output of the adder 24 is supplied to 
a divider 25 as a dividend. The output of the adder 22 
is supplied to the divider 25 as a divisor. An output 
(quotient) of the divider 25 is used as input data of the 
memory 20. 

In the construction of Fig. 4 mentioned above, 
when a certain address Ai corresponding to one block 
of the SD video signal is first accessed, since the 
read-out outputs of the menfK)ries 20 and 21 are equal 
to 0. data X1 of one block of the HD video signal Is 
directly written Into the memory 20 and a value in the 
corresponding address in the memory 21 is set to 1. 
When this address is again accessed after that, the 
output of the adder 22 Is equal to 2 and the output of 
the adder 24 is equal to (XI + X2)(X2 is the output of 
the delay circuit 13). Therefore, the output of the div- 
ider 25 is equal to (XI + X2)/2 and is written into the 
memory 20. On the other hand, a frequency 2 is writ- 
ten into the frequency 21. Further, when the above 
address is after that, the data in the memory 20 is up- 
dated to (XI + X2 + X3)/3 and the frequency is also 
updated to 3 by operations similar to the above. 

By executing the operations mentioned at>ove for 
a predetermined period of time, a mapping table indi- 
cative of the correlation between the block of the HD 
video signal and the block of the SD video signal 
which were formed from the same video signal is stor- 
ed into the memory 20. In other words, when a pat- 
tern of the data of the block of the SD video signal is 
given, a mapping table which generates the pattern 
of the block of the HD video signal which can corre- 
spond to such a pattern as an average can be formed. 
This mapping table is stored into memory 3 of the 
construction of Fig. 2. 

Next, the second embodiment of the invention 
will now be explained. The embodiment relates to an 
example in which a video signal of 25 frames per sec- 
ond such as PAL system i.e.. video signal having low 
resolution in time-base direction (hereinlater. referred 
to as an SD video signal) is converted into a video sig- 
nal of 30 frames per second such as NTSC system 
i.e., video signal having high resolution in time-base 
direction (hereinbelow. referred to as an HD video 
signal). In the case of this example in Fig. 2 men- 
tioned above, a digital SD video signal is supplied to 
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an input terminal shown by reference numeral 1. As 
an example of the SD video signal, there is a repro- 
duction signal of SDVTR, a broadcasting signal, or 
the like. The SD video signal is converted from an or- 
der of an ord inary raster scan to an order of blocks by 
a block segmentation circuit 2. 

As shown in Fig. 5, a video signal converted into 
a three-dimensional block comprising areas P1 to P5 
obtained by extracting the same portions of succes- 
sive five frames, and each area includes (2x2x8 bits 
= 32 bits) is generated as an output of the block seg- 
mentation circuit 2. The signal of (32 x 5 = 160 bits) 
is supplied to a memory 3 as addresses. A mapping 
table based on the correlation between the SD image 
and the HD image has been stored into the memory 
3 as will be explained hereinlater. 

A video signal containing areas Q1 to Q6 of (2 x 
2x8 bits) and each area occupies the same portions 
in successive six frames is read out from the memory 
3 as shown in Fig. 5. In other words, an input signal 
of five frames is converted into an output signal of six 
frames. The position of each area of three- 
dimensional blocks of the output image is equal to 
that of each area of three-dimensional blocks of input 
image. 

Output image data read out from the memory 3 
is supplied to a block separating circuit 4 and the or- 
der of the data is converted into the order of the raster 
scan. Output Image data from the block separating, 
circuit 4 is taken out to an output terminal 5. The mon- 
itor is connected to the output terminal 5 through a 
D/A converter (not shown). Since the output image is 
converted into 30 frames per second, the image can 
be reproduced by the monitor for NTSC. 

An example of a construction to make the map- 
ping table which is stored in the memory 3 is shown 
in Fig. 6. In Fig. 6. a digital video signal of 150 frames 
per second is supplied to an input terminal indicated 
at reference numeral 11. The 150 frames is the least 
common multiplied number of 25 frames and 30 
frames. It is desirable that the input video signal is a 
standard signal in consideration of the formation of 
the mapping table. 

The input video signal is supplied to thinning-out 
circuits 26 and 28. The thinning-out circuit 26 forms 
a video signal of 30 frames per second by thinning out 
the input video signal to 1/5 in the time direction. The 
thinning-out circuit 28 forms a video signal of 25 
frames per second. The output video signals of the 
thinning-out circuits 26 and 28 are supplied to block 
segmentation circuits 27 and 29, respectively. The 
block segmentation circuit 27 converts the video sig- 
nal of the order of the raster scan into the structure 
of the three-dimensional blocks of (2 x 2 x 6 frames). 
The block segmentation circuit 29 converts the video 
signal of the order of the raster scan Into the structure 
of the three-dimensional blocks of (2 x 2 x 5 frames). 

The output video signal from the block segmen- 



tation circuit 29 is supplied to a memory 20 and a fre- 
quency memory 21 as their addresses. The memory 
20 has address spaces of 2^^^ and data of (2 x 2 x 6 
X 8 bits = 192 bits) is written into those addresses. Al- 

5 though the frequency memory 21 also has the same 
address space as that of the memory 20, a frequency 
is written as data into the respective address. That is, 
read-out output of the memory 21 is supplied to an ad- 
der 22 and is increased by -t-l and an output of the ad- 

10 der 22 is written to the same address in the memory 
21 . The contents of the addresses in the memories 20 
and 21 are cleared to zero as initial states. 

The data of 192 bits read out from the memory 20 
is supplied to a multiplier 23 and is multiplied to a fre- 
ts quency read out from the frequency memory 21. An 
output of the multiplier 23 is supplied to an adder 24 
and is added to input data from the block segmenta- 
tion circuit 27 by the adder 24. An output of the adder 
24 is supplied to a divider 25 as a dividend. The output 

20 of the adder 22 is supplied to the divider 25 as a div- 
isor. An output (quotient) of the divider 25 is used as 
input data of the memory 20. 

In the construction of Fig. 6 mentioned above, 
when a certain address Ai corresponding to one block 

25 of the SD video signal is first accessed, since the 
read-out outputs of the memories 20 and 21 are equal 
to 0, data XI of one block of the HD video signal is 
directly written into the memory 20 and a value in the 
corresponding address in the memory 21 is set to 1. 

30 When this address is again accessed after that, the 
output of the adder 22 is equal to 2 and the output of 
the adder 24 is equal to (XI X2) (X2 Is the output 
of the delay circuit 13). Therefore, the output of the 
divider 25 is equal to (XI + X2)/2 and is written into 

35 the memory 20. On the other hand, a frequency 2 is 
written into the frequency 21. Further, when the 
above address is after that, the data in the memory 
20 is updated to (XI + X2 + X3)/3 and the frequency 
is also updated to 3 by operations similar to the 

40 above. 

By executing the operations mentioned above for 
a predetermined period of time, a mapping table indi- 
cative of the correlation between the block of the HD 
video signal and the block of the SD video signal 

45 which were formed f rom t he same video signal is stor- 
ed into the memory 20. In other words, when a pat- 
tern of the data of the block of the SD video signal is 
given, a mapping table which generates the pattern 
of the block of the HD video signal which can corre- 

50 spend to such a pattern as an average can be formed. 
This mapping table is stored into memory 3 of the 
construction of Fig. 3, 

Fig. 7 shows still another embodiment of the 
present invention. This embodiment intends to reduce 

55 the capacity of the memory for formation and storage 
of the nnapping table. The three-dimensional ADRC 
encoder6 is added to the output of the block segmen- 
tation circuit 2. ADRC(Adaptive Dynamic Range Cod- 
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ing) is proposed by the present applicant In ADRC. 
the bit number of each pixel is compressed from 8 bits 
to. for example. 4 bits by using the fact that plural pix- 
els in a block have the time and spatial correlation. 

The ADRC encoder 6 comprises: a circuit for de- 5 
tecting a maximum value MAX. a minimum value MIN 
and a dynamic range DR represented with (MAX - 
MIN = DR) of pixel data of block, a circuit for generat- 
ing a quantizing step by equally dividing the dynamic 
range DR by 2^. a subtracter for normarizing the pixel io 
data of block by subtracting the minimum value MIN 
from the pixel data, and a quantizing circuit for divid- 
ing an output of the subtracter by the quantizing step 
i.e., requantizing. The dynamic range DR per block, 
the minimum value MIN and the four-bit code signal is 
DT corresponding to each pixel are output from the 
ADRC encoder 6. 

The code signal DT of the output signals from the 
ADRC encoder 6 is supplied to the memory 3 as the 
addresses. The video signal that frame number has 20 
been converted in accordance with the mapping table 
Is read out from the memory 3. The dynamic range 
DR and the minimum value MIN of encoded outputs 
from the ADRC encoder 6 are supplied to a delay cir- 
cuit 7. The dynamic range DR of the output of the de- 25 
lay circuit 7 is fed to a divider 8. and divided by 2^ = 
16. Thus, the quantizing step of the block is obtained 
by the divider 8. 

The code signal of the block of the output image 
signal which is read out from the memory 3 is supplied 30 
to a multiplier 9. Since the quantizing step is fed to the 
multiplier 9. the data after removing the minimum val- 
ue is restored at the multiplier 9. The output signal of 
the multiplier 9 is supplied to an adder 10, and the 
minimum value MIN from the delay circuit 7 is added. 35 
As a result, the restored data is fed to a block sepa- 
ration circuit 4. and order of data is converted into the 
order of the raster scan. The output image data from 
the block separation circuit is taken out to an output 
terminal 5. 40 

Since the example of the embodiment shown in 
Fig. 7 compresses the data per block by ADRC. the 
capacity of the memory 3 can be reduced. In addition, 
the process for forming the mapping table is the 
same as the above except that the correlation be- 45 
tween the ADRC encoded signals are detected. Thus, 
the capacity of the memory 3 for forming the mapping 
table can be reduced. It is needless to say that the 
embodiment in Fig. 7 can be similarly applied to a con- 
version for improving the spatial resolution in Fig. 3. 50 

Fig. 8 shows an example of a construction to form 
the mapping table which is stored in the memory 3 in 
Fig. 7. when the embodiment In Fig. 7 is applied for 
improving the spatial resolution. In Fig. 8. a digital HD 
video signal is supplied to an input terminal shown by 55 
reference numeral 11. It is desirable that the HD video 
signal is a standard signal in consideration of the for- 
mation of the mapping table. For example, a signal 



comprising still Images of various picture patterns can 
be used. The HD video signal can be actually ob- 
tained by photographing a standard image by an HD 
video camera or by recording an image pickup signal 
into an HDVTR. Further, when the HD video signal to 
be derived as a conversion output has previously 
been known, generality Is not requested. Therefore, 
the mapping table is formed by using an original HD 
video signal. 

The HD video signal is supplied to a block seg- 
mentation circuit 12. The block segmentation circuit 
12 converts the video signal of the order of the raster 
scan into the structure of the blocks of (4 x 4 x 8 bits). 
Two signals having different resolution and encoded 
by ADRC are formed from an output signal of the 
block segmentation circuit 12. One of the two signals 
is a signal removing and requantizing the same reso- 
lution as that of the original HD video signal and is 
formed by the delay circuit 13. subtracter 17. dividers 
1 8 and 19. The minimum value MIN is supplied to the 
subtracter 17 from ADRC encoder 16. A quantizing 
step formed at the divider 1 8 Is supplied to the divider 
19. As a result, a data of one pixel which is com- 
pressed into 4 bits is obtained. 

The other signal is an SD video signal and is 
formed by a low pass filter 14 and a sub-sampling cir- 
cuit 15 and the signal is encoded at ADRC encoder 
16. The low pass filter 14 is a two-dimensional digital 
filter and executes a band limit in the horizontal and 
vertical directions In order to prevent an aliasing dis- 
tortion. The sut>-sampling circuit 15 performs the 
sampling such that the numbers of pixels in the hor- 
izontal and vertical directions are reduced into 1/2. re- 
spectively. Therefore, one block of the SD video sig- 
nal from the sub-sampling circuit 15 corresponds to 
the data of (2 x 2 x 8 bits = 32 bits). The data is conrv 
pressed (2x2x4 bits = 16 bits) at the ADRC encoder 
16. 

The code signal DT from the ADRC encoder 16 
is supplied to a memory 20 and a frequency memory 
21 as their addresses. The memory 20 has address 
spaces of 2^^ and data of (4 x 4 x 4 bits ~ 64 bits) is 
written into those addresses. Although the frequency 
memory 21 also has the same address space as that 
of the memory 20. a frequency is written as data into 
the respective address. That is. read-out output of the 
memory 21 is supplied to an adder 22 and is in- 
creased by +1 and an output of the adder 22 is written 
in the same address in the memory 21. The contents 
of the addresses in the memories 20 and 21 are 
cleared to zero as initial states. 

The data of 128 bits read out from the memory 20 
is supplied to a multiplier 23 and is nmjitiplied to a fre- 
quency read out from the frequency memory 21. An 
output of the multiplier 23 Is supplied to an adder 24 
and is added to input data from the delay circuit 1 3 by 
the adder 24. An output of the adder 24 is supplied to 
a divider 25 as a dividend. The output of the adder 22 
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is supplied to the divider 25 as a divisor. An output 
(quotient) of the divider 25 is used as input data of t he 
memory 20. 

In the construction of Fig. 8 mentioned above, 
when a certain address Ai corresponding to one block 5 
of the SD video signal is first accessed, since the 
read-out outputs of the memories 20 and 21 are equal 
to 0. data XI of one block of the HD video signal is di- 
rectly written into the memory 20 and a value in the 
corresponding address in the memory 21 is set to 1 . io 
When this address is again accessed after that, the 
output of the adder 22 is equal to 2 and the output of 
the adder 24 is equal to (XI X2)(X2 is the output of 
the delay circuit 13). Therefore, the output of the div- 
ider 25 is equal to (XI -i- X2)/2 and is written into the is 
memory 20. On the other hand, a frequency 2 is writ- 
ten into the frequency 21. Further, when the above 
address is after that, the data in the menrusry 20 is up- 
dated to (X1 + X2 + X3)/3 and the frequency is also 
updated to 3 by operations similar to the above. 20 

By executing the operations mentioned above for 
a predetermined period of time, a mapping table indi- 
cative of the correlation between the block of the HD 
video signal and the block of the SD video signal 
which were formed from the same video signal is stor- 25 
ed into the memory 20. In other words, when a pat- 
tern of the code signal of the block of the SD video 
signal is given, a mapping table which generates the 
pattern of the code signal of the block of the HD video 
signal which can correspond to such a pattern as an 30 
average can be formed This mapping table is stored 
into memory 3 of the construction of Fig. 7. 

In the process to form the mapping table men- 
tioned above, the data cannot be actually written into 
ail of the addresses in the memory 20 and the ad- 35 
dresses in which the data is equal to 0 can occur. In 
such a case, the interpolation is performed by the 
data predicted from the data which is not equal to 0 
in the peripheral addresses. An example of a con- 
struction for such an interpolation is shown in Fig. 9. 40 

In Fig. 9. a memory 30 is a memory in which the 
mapping table formed as mentioned above has been 
stored. One of the addresses of 32 bits from counters 
31 and 32 is selectively supplied through a switching 
circuit 33 as an address input of the memory 30. A 45 
clock CK from an input terminal 34 is supplied to a 
clock input of the counter 31 through a gate circuit 35. 
The address from the counter 31 is supplied to the 
switching circuit 33. an address memory 36. and a 
comparing circuit 37. The clock CK from an input ter- so 
minal 38 is supplied to the counter 32 and its output 
is supplied to the switching circuit 33 and comparing 
circuit 37. An output of the address memory 36 is sup- 
plied to the counter 32 as a present Input. 

Output data of the memory 30 is supplied to a 55 
non-zero detecting circuit 39 and a buffer memory 
(latch can be also used) 40 and is also supplied to an 
interpolation data forming circuit 42 through a gate 



circuit 41. The interpolation data forming circuit 42 re- 
ceives an output of the buffer memory 40, an output 
of the gate circuit 41 . an output of the counter 31 , and 
an output of the address memory 36 and forms the 
interpolation data in place of the zero data. The inter- 
polation data is set to a data input of the memory 30. 

A detection signal of the non-zero detecting cir- 
cuit 39 is supplied to a flip-flop 43 as a set input. The 
detection signal is further used to control the on/off 
operations of the gate circuit 41. to control the writ- 
ing/reading operations of the buffer memory 40 and 
address memory 36. and to control the counter 32. 

An output of the comparing circuit 37 to compare 
the outputs of the counters 31 and 32 is supplied to 
a clear terminal of the counter 32 and a reset terminal 
of the flip-flop 43. The on/off operations of the gate 
circuit 35. the switching operation of the switching cir- 
cuit 33, and the writing operation of the memory 30 
are controlled by an output signal of the flip-flop 43. 

It is assumed that a part of the data stored in the 
memory 30 is as shown in the following table 1 in or- 
der to explain the operation of the construction of the 
interpolation data formation in Fig. 9 mentioned 
above. 



[Table 1] 



Adress 


Data 


AO 


DO 


AI 


D1 


A2 


D2 


A3 


0 


A4 


0 


A5 


D5 



A count value of the counter 31 is first increased 
by the clock CK and address signals which are se- 
quentially generated are supplied to the memory 30 
through the switching circuit 33. The read-out data 
from the memory 30 is supplied to the non-zero de- 
tecting circuit 39. In the case where the read-out data 
is not equal to 0, namely, when the data is obtained 
by a training image, the content on the buffer memory 

40 is read out and the output of the memory 30 is new- 
ly written into the buffer memory 40. Further, the gate 

41 is turned on and the output of the memory 30 is 
supplied to the interpolation data forming circuit 42. 

When considering the timing at which data D5 in 
an address A5 in the memory 30 was read out as in 
the example mentioned above, since it is not equal to 
0, preceding non-zero data 02 is read out from the 
buffer memory 40 by the detection signal of the non- 
zero detecting circuit 39. The data D5 is written into 
the buffer menrK)ry 40. The data D5 is supplied to the 
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interpolation data forming circuit 42 through the gate 
circuit 41 . The data 02 is also supplied to the interpo- 
lation data forming circuit 42. 

On the other hand, since the address Input to the 
memory 30 in this instance is equal to A5, it is written 5 
into the address memory 36 by the non-zero detec- 
tion signal. An address A2 which has already been 
stored before is read out from the address memory 
36. Those addresses A2 and AS are supplied to the 
interpolation data forming circuit 42. The interpolation io 
data to be used in place of the zero data in addresses 
A3 and A4 between the data D2 and 05 is formed 
from the data 02 and 05 with reference to the ad- 
dresses A2 and A5. 

A weighting mean value corresponding to a dis- 
tance is formed as interpolation data in this example. 
That is, a distance between the addresses A2 and A5 
is set to 3 and the interpolation data in the address A3 
is obtained as (2 02 05)/3. The interpolation data 
in the address A4 is derived as (02 + 2 05)/3. As a 
forming method of the interpolation data, a curve fit- 
ting, a high-order interpolation, or the tike can be used 
in addition to the above method. 

The address A2 from the address memory 36 is 
loaded into the counter 32 by the non-zero detection 
signal. The output of the counter 32 sequentially gen- 
erates the addresses A3 and A4 by the dock CK. 
When the output of the counter 32 reaches A5. the 
comparing circuit 37 generates a coincidence output. 
The counter 32 is cleared and the flip-flop 43 is also 
reset by the coincidence output. 

The switching circuit 33 selects the addresses 
(A3. A4) from the counter 32 and the memory 30 is 
set into the writing mode for a period^ of time during 
which the flip-flop 43 is set Therefore, the interpola- 
tion data (2 02 + 05)/3 and (02 -t- 2 05)/3 are respec- 
tively written into the addresses A3 and A4 in the 
memory 30. The gate circuit 35 Is turned off and the 
increment of the counter 31 is stopped for this period 
of time. 

For a period of time during which the flip-flop 43 
is reset, the gate circuit 35 is turned on, the switching 
circuit 33 selects the address from the counter 31, 
and the memory 30 is set into the reading mode. Op- 
erations similar to those mentioned above are subse- 
quently executed. 

Although the embodiment mentioned above re- 
lates to the example in which the SO video signal is 
up converted into the HO video signal, the invention 
can be also similarly applied to the enlargement of an 
image in addition to the above example. 

It is to be understood that, while a number of em- 
bodiments have been described above, various 
changes and modifications may be effected therein 
by one skilled in the art without departing from the 55 
scope of the invention. 

From the above, it will be seen that, since the 
high resolution component is reconstructed by using 



the correlation between the low resolution image and 
the high resolution image, the standard video signal 
is converted into the high resolution image and can 
be displayed on the HO monitor. The image can be 
also enlarged to an arbitrary size without deteriorat- 
ing the resolution. The image can be, further, thinned 
out and compressed without a deterioration of the re- 
solution. 



Claims 

1. A digital video signal converting apparatus for 
converting a first digital video signal having a first 

15 resolution to a second digital video signal having 
a second resolution higher than said first resolu- 
tion, comprising: 

block segmentation means for converting 
said first digital video signal into a block format 
20 memory means having a mapping table 

stored therein and having address terminals to 
which said first digital video signal in a block for- 
mat is supplied and output terminals from which 
said second digital video signal in block format is 
25 output and 

block separation means for converting 
said second digital video signal in a block format 
into a digital video signal in a raster scan order, 
wherein said mapping table in said menr>- 
30 ory means is generated by training utilizing a plur- 
ality of images said training step being performed 
by generating first and second digital video signal 
corresponding to each of said plurality of images, 
converting each of said first and second digital 
35 video signals into a block format and selecting 
said first digital video signal in a block format is 
an address signal for said mapping table and in- 
putting said second digital video signal in a block 
format to a memory area corresponding to said 
40 address, and generating data of the mapping ta- 
ble from the signal stored in said memory area. 

2. A digital video signal converting apparatus ac- 
cording to claim 1. wherein said first and second 

45 resolutions are spatial resolutions. 



A digital video signal converting apparatus ac- 
cording to claim 2. wherein said first digital video 
signal is a signal in accordance with NTSC stan- 
dard, and said second digital video signal Is a sig- 
nal in accordance with HO standard. 



50 



A digital video signal converting apparatus ac- 
cording to claim 1. wherein said first and second 
resolutions are time resolutions. 

A digital video signal converting apparatus ac- 
cording to claim 4. wherein said first digital video 
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signal is a signal in accx>rdance with PAL stan- 
dard, and said second digital video signal Is a sig- 
nal In accordance with NTSC standard. 

6. A digital video signal converting apparatus ac- 5 
cording to claim 1, wherein block segmentation 
means includes block compression coding 
means, and block separation means includes 
block decoding means. 

10 

7. A digital video signal converting apparatus ac- 
cording to claim 6. wherein said block compres- 
sion coding means is an AORC encoder. 

8. A digital video signal converting apparatus ac- is 
cording to daim 1. wherein said training step in- 
cludes a step which interpolates the data in the 
address area of the mapping table having no 
data. 
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Fig. 9 
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